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1.  INTRODUCTION 


At  Space  and  Naval  Warfare  Systems  Center  Pacific,  our  research  programs  have  developed 
quantitative  models  of  operator  and  system  performance  that  form  the  basis  of  a  scientific  design 
approach  that  can  be  utilized  by  future  Combat  System  Design  Engineers  (DiVita,  Morris,  &  Osga, 
2004;  DiVita,  Morris,  &  Osga,  2005;  DiVita,  Morris,  &  Nguyen,  2005;  DiVita,  Morris,  &  Osga, 
2006).  These  models  were  developed  for  Air  Defense  and  Land  Attack  combat  systems,  and  were 
incorporated  into  prototypes  of  the  future  Multimodal  Watchstation  (MMWS)  and  Land  Attack 
Weapons  Systems  (LAWCS)  (Osga,  Van  Orden,  Campbell,  Kellmeyer,  &  Lulue,  2002).  Several 
projects  (e.  g.,  MMWS,  LAWCS,  and  Combat  Supervisory  Support  Systems)  have  demonstrated 
tools  that  form  the  foundation  for  further  development  of  interface  concepts  that  will  enable 
operators  to  plan  and  execute  complex  tasks  within  dynamic  and  multiple  warfare  areas.  Our  research 
was  designed  to  answer  the  growing  need  to  model  interface  concepts  so  that  future  interface  designs 
may  evolve  in  a  principled  and  systematic  fashion. 

One  critical  aspect  in  developing  a  quantitative  model  of  operator  and  system  performance  has 
been  to  adopt  a  task  centric  approach  to  interface  design  that  entails  an  explicit  representation,  of 
actions  -  tasks  -  that  need  to  be  performed  by  the  operator.  The  representation  of  work  in  terms  of  a 
task  serves  as  a  trace  in  the  system  that  enables  designers  to  track  workload  in  addition  to  the  task 
progress  and  flow  of  tasks  among  team  members.  In  supervisory  control,  we  are  interested  in  the 
flow  of  tasks  (work)  through  a  system  that  is  composed  of  human  servers  and  automated  servers 
(software  agents).  Quantitative  models  and  methods  that  analyze  dynamic  systems  of  flow  have  been 
developed  in  the  domain  of  queueing  theory.  At  SSC  Pacific,  we  have  applied  queueing  theory  to 
teams  of  air  defense  warfare  fighters  (DiVita,  Morris,  &  Osga,  2004;  DiVita,  Morris,  &  Osga,  2005; 
DiVita,  Morris,  &  Nguyen,  2005;  DiVita,  Morris,  &  Osga,  2006;  DiVita,  Morris,  &  Osga,  2007  ) 

This  research  may  be  extended  to  include  supervisory  control  of  unmanned  vehicles  (UVs).  In  this 
analysis,  the  “customers”  to  the  queue  are  tasks  that  must  be  serviced  by  the  human  and  software 
servers.  The  servers  are  human  operators,  software  agents,  and  UVs. 

Although  the  appropriate  operator  role  in  supervising  autonomous  systems  has  yet  to  be 
determined,  it  is  clear  that  the  prevalence  of  autonomous  systems  is  in  an  upward  trend  for  the 
foreseeable  future.  While  some  military  planners  envision  truly  autonomous  systems,  most 
understand  that  warfighters  need  to  be  able  to  command  and  control  these  systems  at  some  level.  The 
future  of  human  factors  challenges  has  undoubtedly  shifted  from  manually  controlling  individual 
unmanned  systems,  to  supervisory  command  of  multiple  semi-autonomous  systems  (Kellmeyer  & 
DiVita,  2012).  For  example,  a  futuristic  Network  Centric  Operations  (NCO)  mission  scenario  is  one 
in  which  a  group  of  heterogeneous  UVs  are  supervised  by  a  single  operator  using  NCO  technology 
(Rodas,  Veronda,  &  Szatkowski,  2011;  Rodas,  Szatowski,  &  Veronda,  201 1).  In  addition  to  physical 
platforms,  autonomous  agents  working  as  virtual  team  members  are  prevalent  tools  for 
accomplishing  naval  missions  in  these  NCO  scenarios.  The  coordination  of  actions  and  interactions 
between  unmanned  autonomous  systems,  manned  systems,  and  a  command  group  will  be  essential  to 
accomplishing  these  future  missions  (Kellmeyer  &  DiVita,  2012).  In  this  type  of  complex  command 
and  control  (C2  scenario,  UV  operators  will  be  subjected  to  vast  amounts  of  information.  Therefore, 
this  theory  of  warfare  brings  with  it  a  new  problem  that  must  be  addressed:  How  to  maintain  an 
adequate  workload  to  avoid  information  overload  and  resulting  loss  of  situation  awareness.  It  is 
critical  that  designers  develop  predictive  models  of  human  and  system  performance  to  evaluate  the 
adequacy  of  a  system’s  design  to  satisfy  specific  mission  requirements  and  ensure  adequate  operator 
performance  (Rodas,  Veronda,  &  Szatkowski,  2011). 
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In  order  to  explore  the  operator’s  role  in  supervising  UVs,  SSC  Pacific  acquired  the  Research 
Environment  for  Supervisory  Control  of  Heterogeneous  Unmanned  Vehicles  (RESCHU) 
developed  by  the  Massachusetts  Institute  of  Technology  (MIT).  The  RESCHU  simulator 
(Nehme,  2009)  was  developed  to  test  supervisory  control  tasks  such  as  surveillance  and 
identification.  This  simulation  was  modified  by  adding:  1)  a  complex  mission  scenario  with  an 
asset  to  protect  and  multiple  simultaneous  enemies  to  attack,  2)  a  highly  automated  system  such 
as  mission  definition  language  (MDL),  and  3)  a  highly  heterogeneous  team  that  is  made  of  at 
least  three  different  types  of  UVs.  The  new  version  of  the  simulation  is  called  RESCHU  SP  and 
details  of  the  modification  are  discussed  in  Rodas,  Veronda,  &  Szatkowski,  2011. 

In  the  RESCHU  SP  scenario,  a  single  operator  supervises  a  team  of  unmanned  air  vehicles 
(UAVs),  unmanned  surface  vehicles  (USVs),  and  unmanned  underwater  vehicles  (UUVs).  The 
operator’s  task  is  to  deploy  the  UVs  to  identify  and  destroy  enemy  contacts  that  are  attacking  an  oil 
platform  at  sea.  In  addition  to  defending  the  oil  platform,  the  operator  must  direct  the  UVs  away  from 
hazardous  areas  that  cause  damage  to  the  UVs.  The  interface  for  the  simulation  is  depicted  in  Figure 
1.  The  operator’s  display  is  composed  of  two  main  windows  placed  side  by  side.  In  one  window,  a 
geo-situational  display  depicts  the  spatial  position  of  the  UV  assets  as  well  as  the  oil  rig,  unknown 
contacts,  enemy  contacts,  and  the  hazard  areas.  The  second  adjacent  window  is  a  three-tabbed  pane 
window  that  contains  the  following  displays:  Vehicle  Information,  The  Collaborative  Sensing 
Language  (CSL)  Editing  Controls,  and  a  Payload  View. 
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Figure  1 .  RESCHU  SP  interface. 


In  order  to  protect  the  oil  rig  and  the  UV  assets,  the  operator  must  engage  in  five  tasks:  1)  Assign 
to  identify  an  unknown  contact,  2)  Engage  to  identify  an  unknown  contact,  3)  Assign  to  attack  an 
enemy,  4)  Engage  to  attack  an  enemy  contact,  and  5)  Hazard  avoidance.  Figure  2  illustrates  the 
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assign  to  identify  task.  The  scenario  is  designed  such  that  only  US  Vs  can  identify  unknown  contacts 
and  only  UUVs  can  attack  enemy  contacts.  The  UAVs  fly  in  predetermined  flight  patterns  that  the 
operator  can  change  to  avoid  hazardous  areas. 


Figure  2.  Assign  to  identify  task. 


The  operator  must  first  select  an  unidentified  contact,  symbolized  by  a  yellow  icon  on  the  geo- 
situational  display,  and  then  assign  a  USV  to  identify  it  (Figure  2).  In  the  CSL  editing  control  pane, 
the  operator  may  hit  the  “Submit  All”  button  to  automatically  assign  the  contact  an  available  USV 
(see  Figure  1).  Alternatively,  the  operator  may  directly  assign  a  USV  to  identify  the  unknown  contact 
by  dragging  the  USV’s  goal  point  onto  the  unknown  contact.  Once  the  USV  arrives  at  the  unknown 
contact’s  location,  symbolized  by  a  flashing  dark  yellow  icon,  the  operator  may  engage  the  USV  to 
identify  the  contact  (Figure  3). 
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Figure  3.  Engage  to  identify  task. 


This  action  brings  up  a  picture  in  the  Payload  view  that  allows  the  operator  to  visually  identify  the 
contact  as  a  friend  or  foe  (Figure  4).  Once  identified  as  an  enemy,  the  contact  may  be  assigned  a 
UUV  to  attack  it. 


CSL-Editor  and  Vehicle  Information  Viewer 


Message 

00:41-  Your  Vehicle  [7]  has  been  automatically  assigned  by  CSL  Mission  'B' 
01:20—  Vehicle  [6]  has  reached  its  target. 

1 01:27-  [MISSIONS)]:  Is  this  a  hostile  vehicle? 

>Msg: ! i[ 

/  Vehicle  Information ~f  CSL  Editing  Controls  \  Payload  View 


HH 


SEND 


* 


Mission  Statement 
[MISSIONS)]:  Is  this  a  hostile  vehicle? 


Figure  4.  Image  data  supplied  by  USV. 
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The  sequence  of  actions  to  attack  is  analogous  to  the  identification  process.  An  enemy  contact  is 
selected  to  be  assigned  a  UUV  for  attack.  Notice  that  an  enemy  contact  appears  red  in  the  map  to 
indicate  that  it  was  identified  as  the  enemy  (Figure  5). 


Figure  5.  Assign  to  attack  task. 


In  the  CSL  editing  control  panel,  the  operator  hits  “Submit  All”  to  automatically  assign  a  UUV  for 
attack.  Again,  the  operator  may  manually  assign  a  UUV  to  attack  the  contact;  however,  this  action  is 
not  encouraged  in  the  simulation  tutorial.  Once  the  UUV  has  arrived  at  the  target’s  location,  the  red 
enemy  icon  flashes  and  the  operator  may  select  the  icon  to  be  engaged  to  attack  (Figure  6).  Once 
engaged,  the  enemy  is  attacked  and  eliminated.  Its  icon  disappears  from  the  geo-situational  display. 
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Figure  6.  Engage  to  attack  task. 


Lastly,  in  Figure  7,  a  hazard  avoidance  task  is  depicted.  The  operator  manually  changes  the  UV’s 
goal-point  to  avoid  the  hazard  zone. 


Figure  7.  Hazard  avoidance  task. 
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The  relationships  between  the  operator,  the  CSL,  the  UVs  and  the  manner  in  which  they  must 
process  tasks  may  be  modeled  as  a  network  of  interactive  queues.  Figure  8  shows  the  general  model 
for  a  network  of  queues  involving  these  servers.  In  an  “open”  queuing  system,  “customers”  (tasks) 
arrive  at  each  of  the  servers.  Some  tasks  are  processed  and  leave  the  system,  but  other  tasks  may  be 
passed  from  one  server  to  another.  Thus,  tasks  may  sequentially  arrive  at  different  queues,  be  waited 
upon  by  different  servers,  and  sometimes  may  “feedback”  and  return  to  a  previous  server  before 
eventually  leaving  the  system.  In  Figure  8,  the  circles  represent  servers:  the  operator,  the  CSL,  and 
the  UVs  all  are  servers.  Tasks  from  both  within  the  network  and  outside  the  network  may  arrive  at  a 
server’s  queue.  The  appearance  of  a  new  unknown  contact  in  the  battle  space  marks  the  arrival  of  a 
task  to  the  operator  to  identify  the  contact.  In  turn,  the  servers  may  pass  each  other  tasks  within  the 
network.  For  instance,  the  operator  may  submit  to  the  CSL  one  or  more  contacts  for  identification  or 
attack  assignment.  Likewise,  the  CSL  requests  the  operator  to  submit  one  or  more  contacts  for 
identification  or  attack.  The  operator  may  also  directly  assign  UV  assets  to  identify  or  attack 
contacts,  or  may  simply  redirect  the  UV’s  path  of  motion.  Queueing  theory  provides  quantitative 
tools  to  analyze  the  flow  of  tasks  to  and  from  each  server.  In  addition,  the  overall  performance  of  the 
network  may  be  analyzed.  For  this  study,  we  have  concentrated  only  on  analyzing  the  operator  in  the 
queueing  network  (see  the  Future  Work  section  of  this  report). 


Figure  8.  RESCHU  SP  Queueing  Network. 


In  previous  research,  to  support  the  multitasking  activity  associated  with  supervisory  control,  a 
Task  Manager  (TM)  display  was  incorporated  into  an  operator’s  interface.  (See  for  example,  the 
Multimodal  Watchstation  (MMWS)  and  the  Land  Attack  Combat  System  (LACS),  Osga  et  al., 

2002).  As  shown  in  Figure  9,  the  TM  display  represents  tasks  in  the  form  of  icons  on  a  display  screen 
that  the  system  has  determined  actionable  given  the  current  tactical  information  and  Rules  of 
Engagement  (ROE).  The  posting  of  tasks  to  the  TM  display  for  operators  to  perform  is  analogous  to 
service  calls  arriving  at  a  Help  Desk  or  calls  to  any  telephone  system.  Thus  a  queue  of  tasks  is  clearly 
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represented  by  the  interface.  The  current  display  does  not  have  a  Task  Manager  and  one  may  ask  the 
question,  “where  is  the  operator’s  queue?”  Nonetheless,  the  exact  arrival  time  of  tasks  the  operator 
must  perform,  as  well  as  the  operator’s  start  and  completion  time  for  each  of  the  five  tasks  listed 
above  may  be  determined  from  the  RESCHU  SP  simulation  log  files.  Thus,  all  the  components 
necessary  to  formulate  and  analyze  a  queueing  system  may  be  extracted  from  the  RESCHU  SP 
scenario.  This  leads  us  to  briefly  review  the  elements  of  a  queueing  system. 


Figure  9.  Task  manager  display. 


1.1  ELEMENTS  OF  A  QUEUEING  SYSTEM 


A  queueing  system  is  composed  of  three  main  components: 

1 .  The  input  or  arrival  process.  The  arrival  of  customers  to  a  queue  is  often  unpredictable.  In 
this  case,  arrival  is  modeled  as  a  random  or  stochastic  process.  The  arrival  process  is  often 
assumed  to  be  Poisson  in  nature,  in  which  case  the  arrival  rate,  X,  is  simply  the  reciprocal  of 
the  mean  inter-arrival  time  of  customers.  For  the  Possion  distribution  with  parameter  X,  the 
probability,  /\,  that  k  arrivals  occur  in  the  time  interval  (0,t)  is  given  by: 


Pk(t)  = 


mk  ■-* 

k\ 


Previous  research  revealed  changes  in  the  arrival  rates  of  tasks  in  combat  scenarios.  In 
general,  the  arrival  of  tasks  consisted  of  a  busy  phase  followed  by  a  slower  phase.  This  ebb 
and  flow  of  the  rate  at  which  tasks  appear  may  be  modeled  by  using  the  Modulated  Markov 
Poisson  Process  (MMPP)  (see  Lucantoni,  Meier-Hellstem  &  Neuts,  1990;  Lucantoni  & 
Ramasami,  1985;  Hock  (1996);  DiVita,  Morris,  &  Osga,  2007  for  further  details). 
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2.  The  service  mechanism  and  vacationing  servers.  Service  refers  to  the  number  of  “servers’ 
and  the  duration  of  time  the  customer’s  hold  servers.  Service  time  is  often  modeled  by  a 
continuous  random  variable,  v,  exponentially  distributed  with  parameter  // : 


~/JX 


fix)  =  fie 

The  servicing  of  a  task  may  be  viewed  as  a  process  consisting  of  several  serial  stages.  The 
Erlang  method  of  stages  was  designed  to  quantify  this  situation.  This  method  assumes  that 
the  distribution  of  service  time  for  each  stage  is  exponential.  The  distribution  of  overall 
service  time  is  thus  given  by  the  convolution  of  these  functions.  This  distribution  is  no  longer 
exponential;  hence,  this  method  allows  a  more  general  service  time  distribution  to  be  used  in 
formulating  predictions.  When  dealing  with  convolutions,  it  is  easier  to  work  with  Laplace 
transforms.  Thus,  if  we  assume  that  there  are  r  stages  of  processing,  each  with  identically 
distributed  service  times,  the  service  time  distribution  is  given  by  the  Erlang  distribution: 


Kx)  = 


rju(rjux)' 


Ae~m 


(r-1)! 


The  Laplacian,  B*(s),  for  b(x)  is  given  by: 


r/u 


3. 


B*(s)  = 

'  s  +  r/u  j 

Further  details  of  this  approach  are  given  in  Kleinrock,  1975  &  1976.  One  critical  difference 
between  the  queueing  system  described  above  and  an  operator  engaged  in  supervisory  control 
is  that  when  no  tasks  are  present,  the  server  is  idle;  however,  one  hopes  that  this  is  not  the 
case  with  human  operators.  When  there  are  no  tasks  to  perform,  the  operator  is  still 
examining  the  display.  Ironically,  in  the  RESCHU  SP  scenario,  the  operator  is  determining  if 
a  new  task  needs  to  be  accomplished.  However,  the  operator  is  not  performing  one  of  the  five 
tasks  that  we  have  specified.  Thus,  there  are  “tasks”  the  server  may  perform  that  fall  outside 
the  flow  of  tasks  represented  by  the  arrival  of  tasks  that  have  been  specified  for  analysis. 
These  non-specified  tasks  must  be  taken  into  account  to  quantify  system  performance 
because  they  clearly  will  have  an  impact  on  the  queueing  statistics.  For  example,  if  the 
operator  is  evaluating  information  on  a  tactical  display  and  one  of  the  five  specified  tasks 
arrives,  the  operator  may  finish  his  analysis  before  realizing  there  is  a  new  task.  The  start 
time  for  that  task  is  delayed;  thus,  the  waiting  time  and  overall  time  the  task  spends  in  the 
system  will  be  affected  by  the  operator’s  extra  activity.  Fortunately,  a  queue  with  “service 
vacations”  can  be  adapted  to  model  this  situation  (Takagi,  1991).  The  idea  behind  such 
queues  is  as  follows:  if  there  are  no  customers  in  the  queue  that  need  to  be  served,  the  server 
takes  a  vacation.  If  upon  completion  of  a  vacation,  the  server  returns  only  to  find  that  there 
are  still  no  more  customers,  the  server  takes  another  vacation.  This  process  continues  until 
the  server  returns  to  find  customers  waiting  to  be  served. 

The  queueing  policy  entails  the  method  by  which  the  system  selects  customers:  first-come- 
first-served  (FCFS),  last-come-first-served  (LCFS),  by  priority,  or  at  random  order  service 
(ROS).  Additional  considerations  for  the  queueing  policy  include:  Reneging,  Balking,  and  a 
Finite  Queue  length.  Reneging  refers  to  a  customer  joining  the  queue  only  to  leave  the  queue 
prior  to  obtaining  service.  The  probability  of  a  customer  reneging  is  commonly  modeled 
using  a  negative  exponential  distribution.  Balking  refers  to  the  arrival  of  a  customer,  but  the 
customer  never  enters  the  queue.  Associated  with  balking  is  a  probability  distribution 
conditioned  on  the  number  in  the  queue  when  the  customer  arrives;  that  is,  the  probability 
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that  a  customer  balks  is  a  function  of  the  queue  length  upon  arrival.  Balking  is  related  to  a 
finite  queue  size.  For  a  finite  queue  whose  maximum  number  of  customers  is  K,  if  a  customer 
arrives  to  the  queue  only  to  find  K  customers  already  in  the  system,  that  customer  balks  with 
100%  probability. 

Vital  Statistics  of  a  Queue:  A  queueing  model  with  1)  an  exponential  arrival  process,  2) 
exponential  service  process,  3)  one  server,  4)  finite  queue  size  of  K,  5)  balking  and  reneging, 
and  6)  a  multiple  vacation  policy,  is  represented  with  Kendall’s  notation  as  M/M/l/K  ( a/3 ) 
with  a  vacationing  server.  Here  the  M  is  a  Markovian,  ‘memoryless, ’  exponential  process,  a 
is  the  renege  rate  also  exponential,  and  (3  indicates  the  probability  of  balking. 

Various  distributions  and  statistics  can  be  derived  for  a  queueing  system.  Most  of  these 
expressions  involve  the  quantities  p,  X,  and  p.  For  example,  in  analyzing  the  performance  of 
a  system,  one  may  be  interested  in  (1)  the  average  number  of  customers,  N,  in  the  system  at 
any  time,  (2)  the  average  time  a  customer  spends  waiting,  W,  for  service,  and  (3)  the  total 
average  time,  T,  spent  in  the  system  by  a  customer.  This  time  includes  both  service  and 
waiting  time.  One  useful  result  that  relates  several  of  these  quantities  is  Little’s  Theorem, 
which  states  that  the  average  number  of  customers  to  the  system,  N,  is  equal  to  the  product  of 
the  rate  of  flow  of  customers,  X,  and  the  average  time  spent  in  the  system,  T: 

N  =  XT 

Another  useful  characterization  of  the  system  is  the  probability  distribution  for  the  number  of 
customers  in  the  queue.  For  example,  what  is  the  probability  that  a  visitor  to  the  queue  finds 
n  customers  in  the  queue?  The  equation  associated  with  the  M/M/l/K  ( a [3 )  are  given  in  the 
next  section. 

1.2  EQUATIONS  FOR  THE  M/M/l/K  (a/3)  VACATIONING  SERVER 

Figure  10  depicts  the  steady  state  transition  diagram  for  the  M/M/l/K  (a/3 )  vacationing  server.  In 
this  diagram,  the  empty  ellipses  denote  the  server  is  on  vacation  whereas  the  filled  ellipses  signify 
that  the  server  is  busy.  The  number  inside  each  ellipse  denotes  the  number  of  customers  in  the 
system.  The  maximum  number  in  the  system,  K,  has  be  set  to  4;  thus,  there  are  only  9  possible  states 
for  this  queue.  In  the  diagram,  A  is  a  transition  due  to  an  arrival,  p  is  a  transition  created  when  a 
service  completion  occurs,  a  indicates  a  renege,  and  77  is  a  transition  caused  by  the  completion  of  a 
vacation.  Note  that  bn  is  the  probability  of  an  arrival  joining  the  queue  at  state  n  (for  more  details  of 
this  approach  see  Zhang,  Yue,  &  Yue,  2008). 
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Figure  10.  State  transition  diagram  for  M/M/1 /K  (afi)  queueing  model  with  a 
vacationing  server.  In  this  illustration,  the  number  inside  each  state  defines  the 
number  of  tasks  in  the  system.  The  unfilled  state  ellipses  indicate  vacation  periods, 
and  the  filled  states  indicate  the  system  is  busy.  Labeled  arrows  indicate  a  transition 
between  states.  Here  X  is  a  transition  due  to  an  arrival,  p  is  a  transition  created  when 
a  service  completion  occurs,  a  indicates  a  renege,  and  rj  is  a  transition  caused  by 
the  completion  of  a  vacation.  Note  that  bn  is  the  probability  of  an  arrival  joining  the 
queue  at  state  n.  This  example  shows  a  system  where  the  total  capacity  K  is  4; 
hence,  there  are  no  other  states,  and  tasks  arriving  to  a  full  system  are  lost. 


Let  po(n)  denote  the  probability  that  the  server  is  on  vacation  and  there  are  n  customers  in  the 
queue,  and  let  pi(n)  denote  that  the  server  is  busy  and  there  are  n  customers  in  the  system.  Then  the 
transition  equations  are  given  by: 

PPi(l)  +  <*Po(l)  —  ^Po(O) 

^n-iPo(n  -  1)  +  ap0(n  +  1)  =  (a  +  Abn  +  p)p0(n),n  -  1,2,  —  ,N  -  1 
^jv-iPo(N  -  1)  =  (a  +  r])p0(N) 


rjPo(l)  +  (p  +  a)pi(2)  =  (Abi  +  p)pi(l) 


/U?n_iPi(n  -  1)  +  pp0(n)  +  (p  +  a)Pi(n  +  1)  =  [Abn  +  p  +  -  2,  •••,N  —  1 


Abw_iPi(/V  -  1)  +  pPoOV)  =  [p  +  a]pi(JV) 

The  steady  state  equations  assume  that  flow  into  a  state  is  equal  to  flow  out  of  a  state.  For  example, 
pp1  (1)  +  apo(l)  =  Tpo(0)  states  the  flow  into  the  state  p0  (0)  (no  customers  in  the  queue  and  the 
server  is  on  vacation)  can  only  happen  if  a  service  is  completed  in  state  pi  (1),  [ppi  (1)]  or  if  there  is 
a  renege  in  state  po(l)  [apo(l)].  The  flow  into  po(0)  must  be  equal  to  the  flow  out  of  po(0).  Flow  out 
of  p0(0)  can  only  happen  if  there  is  an  arrival  when  the  queue  is  in  state  po(0),  that  is,  ^p0  (0). 
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Let  P0  =  [p0 (0),  po(l),  -  p0(K)],P1  =  \p1(l),  -  Pl(/O],andP  =  [P0  Pi].  If  Q  is  the 
transition  rate  matrix  of  the  Markov  Process,  then  the  following  equations  must  be  satisfied: 

PQ  =  0 
Pe  =  1 

where  e  is  a  column  vector  with  each  component  equal  to  one.  The  block  form  of  the  matrix  Q  and 
its  subcomponents  are  defined  as: 

Q  =  \B°  A]e  J£(2K+1)x(2K+1) 

C  B^\ 

p  0  •••  0 

0  0  •••  0 

0  0  •••  0 


-0  0  •••  o- 

rj  0  •••  0 

G  RKx0<+1\A  =  0  ry  •••  0  eR(K+1)xK, 

_0  0  ••• 


-—A  A  0  0 

a  —c1  Ab-±  0 

_  0  2  a  -c2  Ab2 

Bo  ~  :  :  :  : 

0  0  0  0 

_  0  0  0  0 


—d-i  Abt  0  0 

p  +  a  —d2  Ab2  0 

0  p  +  2a  —d3  Ab3 

0  0  0  0 

.  0  0  0  0 

G  U.KXK, 


0  0  0 

0  0  0 

0  0  0 

li  +  (K  —  2  )a  ~dK-2 

0  n  +  (K  —  l)a  -[p  +  (/f-l)a] 


q  =  ia  +  Abt  +  77,  dj  =  Abt  +  p  +  (i  —  1  )a,  i  =  1,  ••• ,  K  —  1. 

Here  the  probability  of  joining  the  queue  depends  on  the  number  in  the  system  n: 

1 

j-,  b0  =  lbn  =  0  forn>  K. 

Define, 

Z  =  /  -  CBo 1i4fi1"1  G 
and 
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V  —  et  —  CBg  1e0  G  M*xl 


where  e0  G  1R’ A + 1  x  1 .  and  e1  G  1RIA  x  1  are  column  vectors  whose  elements  are  all  ones.  Then 

Z  =  [V  Zl 

where  Z  is  Z  with  the  first  column  removed.  The  solution  to  the  steady  state  equations  follow: 

Pi  =  gz-1 


P0  =  -P1CBo1, 

where  g  is  a  row  vector  of  length  K 

g  =  [  1  0  ...  o]. 

These  probabilities  may  be  used  to  compute  N,  the  average  number  of  customers  in  the  queue: 

1  K 

V  V 


N  =  OPi(n) 


i= 0  n= 0 

Once  N  is  determined,  Little’s  theorem  can  be  applied  to  compute  the  average  time  in  the  queue, 
T,  and  the  average  waiting  time  in  the  queue;  however,  X  must  be  modified  to  reflect  balking.  Thus 
letting  P  (Balk)  equal  the  probability  of  balking  and  P(Join)  equal  the  probability  of  joining  the 
queue,  we  have: 

1  K 

P(Balk)  =  £^(l-bn)Pi(n) 

i=0  n=i 
1  K 


P(Join)  =  ^^bnpi(n) 


i=0  n=i 


Let 


A  =  AP(Join) 


Then  the  average  time  in  the  system  T  is  given  by: 

N 

T  =  -= 

A 

The  average  time  spent  waiting  for  service  is  given  by: 

where  Nq  jS  the  average  number  in  the  system  waiting  for  service  and  is  given  by: 

1  K 

Nq  =  ^^(n  —  i)Pi(n). 

i= 0  n= i 
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In  order  to  verify  the  equations,  a  simulation  for  a  M/M/l/K  (aj3 )  Vacationing  Server,  with  K=3, 
X  =  0.4000,  p  =  0.2642,  a  =  0.1000,  (3  =  0.5140,  r|  =  0.1000,  was  created  in  Matlab  using  100,000 
customers  arriving  at  the  queue.  In  Table  1,  the  predicted  queueing  statistics  are  compared  to  the 
observed  statistics.  As  can  be  seen,  the  error  is  minor,  on  the  order  of  0.25%.  In  Table  2,  the  po  (n) 
and  pi  (n)  probabilities  are  compared,  predicted  versus  obtained.  Again  the  percent  error  is  minor. 

Table  1 .  Simulation  observed  queueing  statistics  compared  to  predicted 
queueing  statistics.  The  simulation  was  run  with  100,000  customers. 

M/M/l/K  (a/?)  Queue  with  Vacationing  Server 
K  =  3,  A  =  0.4000,  n  =  0.2642,  a  =  0. 1 000,  p=  0.5 1 40,  rj  =  0. 1 000 


N 

T 

W 

Observed 

1 .329230 

6.822919 

4.910755 

Predicted 

1.331202 

6.847554 

4.927672 

%  Error 

0.15 

0.36 

0.34 

Table  2.  Simulation  observed  transition  probabilities  compared  to  predicted  transition  probabilities 
(100,000  customers). 


Po(0) 

Po(1) 

Po(2) 

Po(3) 

Pi(1) 

Pi(2) 

Pi  (3) 

Observed 

0.176741 

0.250199 

0.150256 

0.050282 

0.170865 

0.148172 

0.053485 

Predicted 

0.175494 

0.250706 

0.150423 

0.050141 

0.170806 

0.148868 

0.053561 

%  Error 

0.71 

0.20 

0.11 

0.28 

0.03 

0.47 

0.14 

Figures  1 1  and  12  show  the  change  in  average  number  in  the  queue  N,  when  the  reneging  and 
vacation  parameters  systematically  vary  between  0  and  1 .  There  were  two  cases  for  balking.  In  the 
first  case,  “canbalk  =  0,”  bn  =  1,  for  n  <  K  and  bn  =  0  for  n  >  k.  In  the  second  case,  “canbalk  =  1,”  bo 
=  1,  bn  =  l/(n+l),  for  n  <  K  and  bn  =  0  for  n  >  k. 
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X  =  0.4,  |A  =  0.2642,  canBalk  =  0  X  =  0.4,  |A  =  0.12,  canBalk  =  0 


Figure  1 1 .  Sensitivity  analysis  when  queueing  system  is  not 
allowed  to  balk  with  the  number  in  the  system  less  than  K. 


In  Figure  1 1,  no  balking  is  allowed  for  n  <  K,  the  maximum  number  the  system  can  hold.  In  the 
upper  panel  of  Figure  1 1,  X,  has  been  held  constant,  (0.4)  while  the  service  rate  has  changed  from 
relatively  fast  to  slow  (p  =  0.2642,  as  opposed  to  p  =  0.12).  Not  surprisingly,  the  decrease  in  service 
rate  forces  N  to  increase.  Figure  1 1  demonstrates  the  rate  of  this  increase  and  how  it  interacts  with 
the  a  and  p  parameters  of  the  queueing  model.  The  lower  half  of  Figure  1 1  increases  the  arrival  rate 
X.  Again  N  increases;  however,  the  a  and  p  parameters  have  a  great  effect  on  the  rate  of  this  increase. 
Figure  12  is  similar  to  Figure  11,  only  now  balking  is  allowed  for  n  <  K.  With  balking  allowed,  the  N 
greatly  decreases. 
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X  =  0.9,  |A  =  0.2642,  canBalk  =1  X  =  0.9,  |i  =  0.12,  canBalk  =  1 


Figure  12.  Sensitivity  analysis  when  queueing  system  is  allowed  to  balk 
with  the  number  in  the  system  less  than  K. 

2.  RESULTS 

The  output  of  the  RESCHU  SP  simulation  is  a  log  file  containing  all  events  that  occur  during  the 
course  of  a  subject  interacting  with  the  simulation.  One  log  file  is  generated  per  mission  with  a  single 
operator.  A  small  set  of  mission  simulation  output  log  files  were  analyzed  manually  to  determine  the 
cues  which  specified  the  arrival  of  a  task,  the  setup  time  prior  to  service  of  the  task  (see  below),  the 
beginning  of  service  performed  by  the  operator,  and  the  end  of  service.  It  was  discovered  that  there 
were  many  occurrences  where  a  task  disappeared  prior  to  the  beginning  of  service.  To  handle  the 
problem,  a  task  renege  time  cue  was  determined  for  all  tasks.  The  renege  time  is  defined  as  the 
projected  time  that  a  task  would  disappear  in  the  event  the  operator  never  performs  service  on  the 
task. 

A  Perl  script  was  created  to  automate  the  parsing  of  each  simulation  output  log  file.  The  Perl  script 
produces  a  list  of  tasks  discovered  during  a  simulation  run.  This  task  list  includes  1)  task  arrival  time, 
2)  task  setup  time,  3)  begin  service  time,  4)  end  service  time,  and  5)  task  renege  time.  The  task  list 
was  sorted  in  ascending  order  on  the  arrival  time. 
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Figure  13.  Lower  arrows  indicate  first  arrival  during  a  vacation  period,  the  middle  arrows 
indicate  the  begin  service  time,  which  starts  a  busy  period,  and  the  upper  arrows  show  the 
departure  time,  which  ends  a  busy  period.  The  busy  period  is  represented  by  the  shaded 
boxes  at  the  bottom  of  the  figure. 


When  an  operator  completes  a  task,  and  a  second  task  is  waiting  for  service,  the  operator  does  not 
immediately  start  the  second  task.  It  was  decided  that  this  behavior  could  partially  be  explained  by  a 
setup  time  performed  by  the  operator  to  regain  situational  awareness.  The  setup  time  was  combined 
with  the  service  time  in  a  two  stage  Erlang-r  service  process.  The  first  stage  of  service  corresponds  to 
activity  required  to  gain  situational  awareness.  The  second  stage  of  service  corresponds  to  the  time  it 
takes  the  operator  to  complete  the  task. 

The  vacation  time  was  computed  as  follows:  A  vacation  period  is  defined  as  starting  when  a  task  is 
completed  and  there  are  no  more  tasks  in  the  queue  to  perform.  A  vacation  period  ends  when  the 
operator  returns  from  vacation  and  resumes  performing  tasks.  Vacation  times  are  determined  by 
subtracting  the  first  arrival  time  of  a  task  during  each  vacation  period  from  the  end  time  of  that 
vacation  period.  By  assuming  that  the  distribution  of  vacation  times  is  exponentially  distributed,  the 
“memoryless”  property  of  the  exponential  allows  us  to  claim  that  the  mean  vacation  time  may  be 
estimated  by  the  average  of  the  vacation  times. 

The  inter-arrival  durations,  combined  service/setup  durations,  renege  durations,  and  vacation 
durations  were  analyzed  to  determine  their  underlying  stochastic  distributions.  For  each  observed 
distribution  of  times,  an  average  was  calculated  and  a  x2  test  of  the  observed  times  was  compared  to 
an  exponential  distribution  with  the  same  mean.  For  the  arrival  process,  the  service  process,  the 
renege,  and  vacation  durations,  analyses  are  depicted  in  Figure  14,  Figure  15,  Figure  16,  and  Figure 
17,  respectively. 
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Arrival  Observed  vs.  Expected  Histogram  -  x2  [accept  HO] 


Figure  14.  Inter-arrival  duration  histogram  shows  that 
the  observed  data  matches  an  Erlang-r  (r  =  1 )  which 
is  equivalent  to  an  exponential  distribution.  A  x2  test 
failed  to  reject  the  hypothesis  that  the  observed  matches 
the  expected. 


Service  Observed  vs.  Expected  Histogram  -  x2  [accept  HO] 


Figure  15.  Service  duration  histogram  shows  that  the 
observed  data  matches  an  Erlang-r  (r  =  1 )  which  is 
equivalent  to  an  exponential  distribution.  A  xA2  test 
failed  to  reject  the  hypothesis  that  the  observed 
matches  the  expected. 
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seconds 


Figure  16.  Renege  duration  histogram  shows  that 
the  observed  data  matches  an  Erlang-r  (r  =  1)  which 
is  equivalent  to  an  exponential  distribution.  A  xA2  test 
failed  to  reject  the  hypothesis  that  the  observed 
matches  the  expected.  However,  only  10  of  the  65 
tasks  reneged  prior  to  the  task  receiving  service. 


seconds 


Figure  17.  Vacation  duration  histogram  shows  that 
the  observed  data  matches  a  three  stage  Erlang-r 
distribution.  A  xA2  test  failed  to  reject  the  hypothesis 
that  the  observed  matches  the  expected. 

In  each  case,  the  binning  of  the  data  was  optimized  to  compare  the  expected  number  of 
observations  from  the  exponential  distribution  to  the  observed  data.  It  was  determined  that  the  inter¬ 
arrival  process,  service  process,  and  renege  process  failed  to  reject  the  null  hypothesis  of  an 
exponential  distribution.  However,  the  vacation  process  rejected  the  exponential  hypothesis.  In  a 
second  analysis,  the  second  moment  of  the  observed  data  was  compared  to  the  second  moment  of  the 
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Erlang-r  distribution,  for  r  =  1,. . 6,  for  the  arrival  process,  the  service  process,  the  renege  and 
vacation  durations.  These  analyses  are  given  in  Table  3,  Table  4,  Table  5,  and  Table  6,  respectively. 


Table  3.  Minimizing  the  error  of  the  observed  vs.  expected  second 
moment  to  find  the  best  fitting  r-stage  Erlang  distribution  indicates  that 
a  single  exponential  stage  best  fits  the  arrival  process. 


r 

M2  Expected 

M2  Observed 

Error 

i 

127.2511 

138.8925 

11.6414 

2 

95.4383 

138.8925 

43.4542 

3 

84.8341 

138.8925 

54.0585 

4 

79.5319 

138.8925 

59.3606 

5 

76.3507 

138.8925 

62.5419 

6 

74.2298 

138.8925 

64.6627 

Table  4.  Minimizing  the  error  of  the  observed  vs.  expected  second  moment 
to  find  the  best  fitting  r-stage  Erlang  distribution  indicates  that  a  single 
exponential  stage  best  fits  the  service  process. 


r 

M2  Expected 

M2  Observed 

Error 

i 

65.4368 

61.5602 

3.8766 

2 

49.0776 

61.5602 

12.4826 

3 

43.6245 

61.5602 

17.9356 

4 

40.8980 

61.5602 

20.6622 

5 

39.2621 

61.5602 

22.2981 

6 

38.1715 

61.5602 

23.3887 

Table  5.  Minimizing  the  error  of  the  observed  vs.  expected  second  moment 
to  find  the  best  fitting  r-stage  Erlang  distribution  indicates  that  a  single 
exponential  stage  best  fits  the  renege  process. 


r 

M2  Expected 

M2  Observed 

Error 

i 

527.1504 

578.9733 

51 .8228 

2 

395.3628 

578.9733 

183.6104 

3 

351 .4336 

578.9733 

227.5396 

4 

329.4690 

578.9733 

249.5042 

5 

316.2903 

578.9733 

262.6830 

6 

307.5044 

578.9733 

271 .4688 
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Table  6.  Minimizing  the  error  of  the  observed  vs.  expected  second  moment 
to  find  the  best  fitting  r-stage  Erlang  distribution  indicates  that  a  three  stage 
best  fits  the  vacation  process. 


r 

M2  Expected 

M2  Observed 

Error 

i 

50.2356 

35.2024 

15.0332 

2 

37.6767 

35.2024 

2.4743 

3 

33.4904 

35.2024 

1.7120 

4 

31 .3972 

35.2024 

3.8051 

5 

30.1413 

35.2024 

5.0610 

6 

29.3041 

35.2024 

5.8983 

As  can  be  seen  from  these  tables,  the  inter-arrival  times,  the  service  times,  and  the  renege 
durations,  a  value  of  r  =1  minimized  the  error.  This  is  equivalent  to  an  exponential  distribution.  For 
the  vacation  durations,  r  =  3  minimizes  the  error.  Since  there  were  a  small  number  of  vacation 
durations  that  were  estimated,  an  exponential  distribution  will  be  assumed  for  all  processes.  The  data 
are  summarized  are  in  Table  7. 

Table  7.  Minimizing  the  error  of  the  observed  vs.  expected  second  moment  to  find 
the  best  fitting  r-stage  Erlang  distribution  indicates  that  the  arrival,  service, 
and  renege  processes  are  best  fit  with  a  single  exponential  stage.  However,  the  vacation 
process  is  best  fit  with  a  three  stage  Erlang  distribution. 


Process 

Best  r 

M2  Expected 

M2  Observed 

Percent 

Error 

Arrival 

1 

127.2511 

138.8925 

9.1484 

Service 

1 

65.4368 

61.5602 

5.9242 

Renege 

1 

527.1504 

578.9733 

9.8307 

Vacation 

3 

33.4904 

35.2024 

5.1118 

For  the  inter-arrival  times  of  tasks,  two  more  analyses  were  performed.  In  Figure  18,  the  running 
average  of  the  arrival  rate  of  tasks  is  presented.  A  change  point  analysis  (Chen  &  Gupta,  2000)  was 
calculated  on  the  inter-arrival  times  of  tasks  to  determine  changes  in  the  arrival  rate.  This  analysis 
revealed  a  single  arrival  phase.  In  Figure  19,  a  MMPP  fitting  algorithm  developed  by  Meier- 
Hellstem  (1987)  was  performed  on  the  data.  This  analysis  corroborated  the  first  change  point 
analysis  and  only  a  single  phase  was  found.  Note  that  the  scenario  contained  two  waves  of  enemy 
vehicles.  In  each  wave,  50  millisecond  inter-arrival  times  were  discovered.  These  short  inter-arrival 
durations  can  be  seen  in  the  figures  at  task  number  3,5-7,  40-43. 
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Real  time  change  point  analysis  of  task  data  min-win:  66 


Figure  18.  Change  point  analysis  of  arrival  distribution  indicates  single  phase  of  average 
duration  7.8538. 


MMPP  fitting  phase  change  analysis  of  task  data  winsize:  4 


Figure  19.  An  MMPP  fitting  algorithm  supports  the  change  point  analysis  which  also 
indicates  only  a  single  phase. 


From  examining  the  log  files,  it  is  clear  that  the  operator  does  not  use  a  FCFS  policy.  This  is  not 
surprising  because  the  interface  does  not  keep  track  of  when  tasks  arrived.  Logically,  some  tasks 
should  have  a  higher  priority  than  others,  although  further  analysis  of  the  data  must  be  conducted  to 
determine  if  there  was  any  prioritization  of  tasks  on  the  part  of  the  operator.  For  the  current  study,  we 
will  assume  that  the  operator  selected  tasks  from  the  queue  randomly.  It  may  be  shown  that  the  key 
averages  for  queueing  statistics  such  as  the  average  number  of  customers  in  the  system,  N,  the 
average  time  spent  in  the  system,  T,  and  average  time  waiting  W,  are  equivalent  for  the  FCFS  and 
ROS  service  policies  (Flatto,  1997).  Future  research  will  examine  task  prioritization. 

In  Table  8,  the  actual  values  observed  from  the  RESCHU  SP  data  are  given  for  the  arrival 
parameter,  k,  the  service  parameter,  p,  the  renege  parameter,  a,  and  the  vacation  parameter,  q.  The 
finite  system  size,  K  was  observed  to  be  six.  A  Matlab  simulation  of  the  M/M/l/K  (aP)  with 
vacationing  server  model  was  run  using  the  observed  parameters  in  Table  8.  Using  100,000  tasks, 
this  simulation  observed  a  balking  rate,  P,  also  listed  in  Table  8.  In  Table  9,  the  predicted  value  for  N, 
W,  and  T  computed  from  the  queueing  equations  are  compared  to  the  observed  values  from  the 
Matlab  simulation.  As  can  be  seen,  the  errors  between  the  predicted  and  observed  values  are  less  than 
1%  (approximately,  0.2%). 
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Table  8.  Actual  parameters  observed  in  RESCHU  SP  mission  simulation. 


K 

X 

a 

fi 

n 

6 

1/7.976563 

1/5.720000 

1/16.235000 

0.0025 

1/5.011765 

6 

0.125367 

0.174825 

0.061595 

0.0025 

0.199531 

Table  9.  Using  the  RESCHU  SP  actual  parameters,  the  observed 
queueing  simulation  is  compared  to  the  predicted  results. 


M/M/l/K  (a (3)  Queue  with  Vacationing  Server 
K  =  6,  A  =  1/7.976563,  ju=  1/5.720000 ,a=  1/16.235000, 
p=  0.0025,  rj=  1/5.011765 


N  T  W 

Simulation  Observed  1.158548  9.254135  5.484697 
Predicted  1.160517  9.279735  5.496177 

%  Error  0.17  0.28  0.21 


In  Table  10,  the  predicted  values  of  N,  W,  and  T  are  compared  to  the  actual  values  calculated  from 
the  RESCHU  SP  scenario  for  one  operator.  The  error  between  the  predicted  and  actual  values  is  on 
the  order  of  20%.  This  is  not  surprising  considering  1)  the  operator’s  vacation  times  were  not 
exponentially  distributed  and  2)  the  operator’s  queuing  policy  was  not  strictly  ROS. 


Table  10.  Actual  observed  queueing  parameters  calculated  from  the 
RESCHU  SP  logfile  are  compared  to  the  predicted  queueing  parameters. 


M/M/l/K  (a /?)  Queue  with  Vacationing  Server 
K=6,X=  1/7.976563,  ju  =  1/5.720000 ,  a=  1/16.235000,^=0.0025, 
_ 77=  1/5.011765 _ 


N 

T 

W 

Actual  Observed 

1.418861 

1 1 .272308 

6.432308 

Predicted 

1.160517 

9.279735 

5.496177 

%  Error 

22.26 

21.47 

17.03 
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3.  CONCLUSIONS 


The  RESCHU  SP  simulation  queueing  model  project  is  an  effort  to  apply  queueing  theory  to  a  UV 
simulation  where  an  operator  is  faced  with  the  task  of  defending  an  offshore  oil  rig.  It  was 
determined  that  an  M/M/l/K  ( a [3 )  queue  with  vacationing  server  was  a  good  first  approximation  to 
the  data.  The  data  were  analyzed  and  the  observed  queueing  parameters  were  used  to  predict,  N,  the 
average  number  of  tasks  in  the  queue,  T,  the  average  time  spent  in  the  queue  (both  waiting  and 
service)  and  W,  the  average  waiting  time  in  the  queue.  The  error  between  the  predicted  values  and 
the  obtained  values  were  on  the  order  of  20%.  This  error  is  due  to  several  factors:  1)  the  operator  did 
not  use  an  assumed  ROS  queueing  policy,  and  2)  the  distribution  of  the  operator’s  vacation  times  was 
not  exponential.  Future  research  (see  next  section)  will  evolve  and  generalize  the  queueing  model  to 
refine  the  predictions. 


4.  FUTURE  RESEARCH 

4.1  EVOLVING  THE  QUEUEING  MODEL 

The  following  research  areas  were  identified  to  evolve  and  generalize  the  queueing  model.  The 
aim  of  targeting  these  areas  is  to  improve  the  model  predictions. 

1 .  Analyzing  Each  Node  of  the  Network 

Figure  8  depicts  the  entire  queuing  network  composed  of  human  operator,  CSL,  and  UVs. 
The  research  discussed  in  this  paper  only  analyzed  the  operator  node.  Each  node  of  the 
network  may  be  analyzed  from  the  point  of  view  of  queueing  theory,  That  is,  for  each  node 
an  arrival  process,  a  service  process,  and  a  queueing  policy  may  be  specified  and  all  the 
queueing  statistics  (e.g.,  N,  T,  W)  can  be  computed.  For  example,  the  load  to  each  node,  2„  is 
the  sum  of  customers  arriving  from  “outside”  the  queue  and  customers  passed  between 
servers.  Thus, 

M 

4  =Yi+Y*A'iPji> 

7=1 

where  yt  is  the  rate  of  flow  of  customers  arriving  from  outside  the  queue,  2,  is  the  total  flow 
of  customers  to  the  /,/,  server,  p,,  is  the  probability  that  customers  arriving  to  the  j,h  server  will 
be  passed  on  to  the  /,/,  server,  and  M  equals  the  total  number  of  servers.  Likewise,  each  server 
would  have  its  unique  service  distribution(s)  and  queueing  policy.  Most  importantly,  by 
modeling  the  entire  network,  bottlenecks  would  be  revealed.  For  example,  there  may  be 
scenarios  where  the  number  of  UV  assets  must  be  increased  in  order  to  successfully  complete 
the  mission,  or  the  performance  and  service  of  the  CSL  must  be  improved.  The  current 
analysis  only  deals  with  the  operator  node,  which  may  not  prove  to  be  the  critical  bottleneck 
in  some  scenarios.  Thus,  increasing  the  number  of  operators  will  not  improve  system 
performance  if  there  are  too  few  UVs  to  identify  or  attack  unknown  and  enemy  contacts. 

2.  Modeling  the  Network  as  a  Hybrid  Open  and  Closed  Queue 

The  network  may  also  be  modeled  as  a  hybrid  open  and  closed  queue.  That  is,  some  aspects 
of  the  network  are  indicative  of  an  open  network,  as  was  discussed  above,  but  other  aspects 
are  indicative  of  a  closed  network.  A  closed  queue  is  one  in  which  customers  never  enter  or 
leave  the  queue;  instead,  they  continuously  cycle  through  the  queue  being  passed  from  server 
to  server.  There  are  aspects  of  the  operator’s  tasks  that  suggest  a  closed  queueing  system.  For 
example,  we  have  stated  that  when  the  operator  no  longer  had  any  of  the  five  analyzed  tasks 
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to  perform,  they  went  off  and  “took  a  vacation,”  hence  the  vacationing  server  parameters 
were  introduced  into  the  analysis.  A  more  accurate  characterization  of  the  operator’s 
behavior  would  be  to  say  that  when  there  are  no  other  tasks  to  perform,  the  operator  serves 
the  ever  present  task  of  gaining  situational  awareness.  In  fact,  with  the  current  RESCHU  SP 
interface,  there  is  no  task  manager  display;  that  is,  there  is  no  list  of  tasks  the  operator  is 
instructed  to  perform.  Thus  the  operator  must  always  be  determining  what  task  to  do  next. 
From  this  perspective,  the  task  -  “figure  out  what  to  do  next”  -  is  always  present  in  a  closed 
queue  fashion.  After  the  operator  performs  a  task,  a  new  “customer”  immediately  appears  in 
the  form  of  the  task  -  “figure  out  what  to  do  next.”  From  this  perspective,  the  setup  time  that 
is  observed  in  the  current  model  could  be  viewed  in  terms  of  service  time  to  perform  this 
closed-queue  task  as  opposed  to  adding  this  setup  time  to  the  next  task  the  operator  finally 
decides  to  perform.  This  perspective  would  lead  to  a  new  set  of  queueing  equations  that  may 
better  describe  the  network’s  performance. 

3.  Expanding  the  RESCHU  SP  Scenario 

The  current  scenario  is  relatively  brief  and  only  lasts  approximately  10  minutes.  A  longer  C2 
scenario  would  not  only  be  more  realistic  but  it  would  also  illuminate  various  aspects  of  the 
queueing  system  that  are  not  accessible  from  a  brief  scenario.  For  example,  a  longer  C2 
scenario  would  likely  show  an  ebb  and  flow  to  the  arrival  of  tasks  that  the  system  is 
responsible  to  process.  System  performance  would  then  be  evaluated  for  both  heavy  and 
small  loads  to  the  system.  In  particular,  the  system’s  ability  to  handle  the  transition  between 
heavy  and  low  workloads  would  also  be  evaluated. 

4.  Generalizing  the  Arrival  Process,  the  Service  Process,  and  the  Queueing  Policy 

Each  aspect  of  the  queueing  model,  arrival,  service,  and  queueing  policy  may  be  generalized 
to  better  represent  the  underlying  process  at  work  in  the  RESCHU  SP  scenario.  With  each 
modification  a  new  queueing  model  may  be  generated  that  leads  to  different  predictions.  All 
of  these  predictions  may  be  compared  to  the  obtained  data  to  determine  what  factors  best 
quantify  system  and  operator  performance. 

5.  Generalizing  the  Arrival  Process 

As  discussed  above,  previous  analysis  of  C2  scenarios  revealed  an  ebb  and  flow  to  tasks  that 
the  operator  must  perform.  This  arrival  process  is  best  modeled  by  the  MMPP  (DiVita, 
Morris,  &  Osga,  2007).  Thus  the  queueing  model  would  have  to  be  modified  to  handle  the 
MMPP  arrival  process. 

In  the  current  analysis,  the  operator  is  responsible  for  handling  five  tasks.  If  the  scenario  was 
expanded,  there  would  be  sufficient  data  to  determine  a  unique  arrival  rate  for  each  of  these 
tasks.  Likewise,  if  the  queueing  policy  was  expanded  to  include  priority  classes  (see  below), 
the  arrival  rate  of  each  class  must  be  considered  separately.  Lastly,  in  the  current  scenario 
there  is  evidence  of  bulk  arrivals;  that  is,  several  tasks  arrive  simultaneously.  The  queueing 
model  could  be  modified  to  handle  bulk  arrival. 

6.  Generalizing  the  Service  Process 

As  discussed  above,  the  Erlang-r  is  an  effective  method  with  which  to  model  operator’s 
service  time  of  tasks.  The  Erlang-r  effectively  represents  the  stages  of  task  completion.  It  is 
very  likely  that  each  of  the  five  tasks  considered  for  analysis  in  this  project  has  a  unique 
service-time  mean  and  distribution.  A  more  fine  grain  analysis  of  operator  performance  and 
more  data  for  each  of  the  operator’s  task  would  reveal  these  differences.  These  different 
service  times  would  then  be  incorporated  into  a  more  detailed  queueing  model.  Such  detail 
would  also  be  necessary  if  the  queueing  policy  allowed  for  the  prioritization  of  tasks. 
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There  is  evidence  of  bulk  service  in  the  current  scenario.  That  is,  n  customers  are  served  at 
once.  This  appears  to  be  the  case  with  the  CSL  when  an  operator  submits  a  number  of 
contacts  to  the  CSL  to  be  identified  or  attacked. 

7.  Generalizing  the  Queueing  Policy  -  Prioritization 

The  current  analysis  assumed  an  ROS  queueing  policy.  Clearly  the  operator  did  not  service 
tasks  in  a  random  order.  There  is  some  evidence  of  prioritization  of  tasks  and  some  evidence 
for  FCFS.  The  problem  with  the  current  display  is  that  it  lacks  a  task  manager  display  that 
captures  the  arrival  time  of  a  task.  One  modification  to  the  display  would  be  to  introduce  a 
task  manager.  This  task  manager  may  also  prioritize  tasks.  For  example,  the  distance  from 
the  oil  rig  and  the  nature  of  the  task  (identification  vs.  attack  vs.  hazard  avoidance)  may  be 
taken  into  account  to  determine  its  importance  relative  to  other  tasks  that  have  to  be 
performed.  System  performance  could  then  be  tested  with  and  without  a  task  manager 
display,  with  particular  emphasis  on  how  the  system  handles  high-priority  tasks.  In  previous 
research,  we  have  modeled  a  prioritization  queueing  policy  and  it  does  increase  the  queuing 
model’s  predictive  capability.  The  problem  with  human  servers  is  that  they  are  often 
inconsistent  with  prioritization,  thus  research  concerning  a  “fuzzy”  prioritization  queueing 
policy  should  also  be  explored. 

8.  Balking  and  Reneging 

If  operator  team  size  is  allowed  to  vary,  then  balking  becomes  an  experimental  factor  in  that 
an  operator’s  queue  is  a  finite  size.  Any  additional  (potentially  lost)  customers  could  then  be 
sent  to  other  operators.  Likewise,  reneging  could  be  handled  differently.  At  present,  a  task 
reneges  and  does  not  get  serviced.  In  the  current  scenario,  this  meant  that  a  UV  did  not  avoid 
a  hazard  zone  and  suffered  damage. 

4.2  DECISION  NETWORK  MODEL 

At  SSC  Pacific,  a  decision  network  model  has  been  developed  to  explore  the  team  size  of  in  the 
RESCHU  SP  simulation  (Rodas,  Veronda,  &  Szatkowski,  2011).  The  queueing  statistics  determined 
in  the  current  study  can  be  used  as  data  to  this  decision  network.  A  decision  network  allows 
researchers  to  capture  qualitative  aspects  of  the  system  as  well  as  the  quantitative  measures  captured 
by  the  queueing  model.  For  example,  the  quality  of  service  is  never  directly  addressed  in  the 
queueing  metrics,  but  the  quality  of  service  could  be  a  factor  in  a  decision  network.  Thus,  various 
queueing  statistics  such  as  average  number  and  time  in  the  system  may  be  made  dependent  on  levels 
of  quality  of  service.  Future  research  is  required  to  blend  the  quantitative  measures  of  system 
performance  derived  from  queueing  theory  with  the  qualitative  measures  of  system  performance  that 
can  be  represented  in  a  decision  network.  The  combination  of  quantitative  and  qualitative  measures 
would  provide  for  a  more  powerful  and  comprehensive  analysis  of  system  performance. 

4.3  CONCLUSION 

The  current  research  project  and  data  analysis  suggests  that  there  are  several  interesting  and 
important  areas  of  research  that  can  be  explored  in  order  to  improve  the  predictability  of  system 
performance  using  queueing  theory. 
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